i(i[r@ m 

HUMAN NEUROSCIENCE 



ORIGINAL RESEARCH ARTICLE 

published: 21 August 2014 
doi: 10.3389/fnhum. 2014. 00642 




Face, eye, and body selective responses in fusifornn gyrus 
and adjacent cortex: an intracranial EEG study 

Andrew D. Engeir and Gregory McCarthy^* 

' Kenyan Psychological Neuroscience Laboratory, Department of Psychology, Kenyon College, Gambler, OH, USA 
^ Human Neuroscience Laboratory, Department of Psychology, Yale University New Haven, CT, USA 



Edited by: 

AIna Puce, Indiana University, USA 
Reviewed by: 

Nathalie George, Centre National de 
la Recherche Sclentifique, France 
Shozo Tobimatsu, Kyushu 
University, Japan 

'Correspondence: 

Gregory McCarthy, Department of 
Psychology, Yale University, PO Box 
208205, New Haven, CT 
06520-8205, USA 
e-mall: gregory. mccarthy@yale. edu 



Functional MRI (fMRI) studies have investigated the degree to which processing of whole 
faces, face-parts, and bodies are differentially localized within the fusifornn gyrus and 
adjacent ventral occipitotemporal cortex. While some studies have emphasized the spatial 
differentiation of processing into discrete areas, others have emphasized the overlap of 
processing and the importance of distributed patterns of activity. Intracranial EEG (lEEG) 
recorded from subdural electrodes provides excellent temporal and spatial resolution 
of local neural activity, and thus provides an alternative method to fMRI for studying 
differences and commonalities in face and body processing. In this study we recorded 
lEEG from 12 patients while they viewed images of novel faces, isolated eyes, headless 
bodies, and flowers. Event-related potential analysis identified 69 occipitotemporal sites 
at which there was a face-, eye-, or body-selective response when contrasted to flowers. 
However, when comparing faces, eyes, and bodies to each other at these sites, we 
identified only 3 face-specific, 13 eye-specific, and 1 body-specific electrodes. Thus, at 
the majority of sites, faces, eyes, and bodies evoked similar responses. However, we 
identified ten locations at which the amplitude of the responses spatially varied across 
adjacent electrodes, indicating that the configuration of current sources and sinks were 
different for faces, eyes, and bodies. Our results also demonstrate that eye-sensitive 
regions are more abundant and more purely selective than face- or body-sensitive regions, 
particularly in lateral occipitotemporal cortex. 
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INTRODUCTION 

The discovery of face-selective neurons in the macaque temporal 
lobe (Gross et al., 1969, 1972) set in motion a productive research 
program in the study of face perception in the primate visual sys- 
tem. Functional neuroimaging (Sergent et al., 1992; Haxby et al., 
1994; Puce et al, 1995) and intracranial EEG (iEEG) (Allison 
et al., 1994a,b) studies expanded that program to the neural basis 
of face perception in the human. These early studies showed that 
faces selectively activated regions of the (predominantly right) 
ventral occipitotemporal cortex ( VOTC). In particular, functional 
MRI studies have consistently identified a small region of the lat- 
eral mid-fusiform gyrus as face selective, a region that is often 
referred to as the "fusiform face area" (FFA; Kanwisher et al., 
1997). Subsequent fMRI research identified a region posterior to 
the FFA, dubbed the "occipital face area" (OFA) that is also pref- 
erentially activated by the perception of faces (Gauthier et al., 
2000). These regions have since been promoted as "core nodes" 
in an extended face processing network (e.g., Haxby et al, 2000; 
Rossion et al, 2003; Calder and Young, 2005; Ishai, 2008; Pitcher 
etal, 2011). 

While regions within the VOTC are unequivocally sensi- 
tive to faces, VOTC regions are also active during perception 
of non-face corporeal stimuli. For example, the perception of 
bodies also evokes a larger hemodynamic response than the 



perception of non-corporeal objects along part of the fusiform 
gyrus (Schwarzlose et al., 2005; Peelen and Downing, 2005; Peelen 
et al, 2006; Pinsk et al, 2009; van de Riet et al, 2009; see de 
Gelder et al., 2010). Although there is substantial overlap between 
VOTC areas activated by faces and by bodies, some studies have 
identified a discrete region activated by bodies that is dissocia- 
ble from the FFA and which has been named the "fusiform body 
area" (FBA; Schwarzlose et al., 2005). Isolated bodies also activate 
lateral occipitotemporal cortex (LOTC) at the intersection of the 
anterior occipital and inferior temporal gyri, an area named the 
"extrastriate body area" (EBA; Downing and Peelen, 20 11). 

Other studies have shown that regions of the occipitotemporal 
cortex (OTC) co-extensive with the FFA, the FBA, and the EBA 
respond to biological motion (Bonda et al., 1996; Grossman and 
Blake, 2002; Peelen et al, 2006; Grezes et al., 2007; Pichon et al, 
2008; Engell and McCarthy, 2013; Shultz et al., 2014). These results 
suggest the possibility that these regions are not responding to 
specific body parts per se, but are engaged by the processing of 
intentional or social agents (Shultz et al., 2014). Indeed, in a recent 
study, Shultz and McCarthy (Shultz and McCarthy, 2012) showed 
that areas of the VOTC co-extensive with the FFA responded to 
the apparently purposeful motion of machines. 

Most studies of non-face corporeal perception have been 
conducted using fMRI. Intracranial electroencephalography has 
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millisecond temporal resolution and, depending upon the con- 
figuration of electrodes, can have high anatomical resolution 
(although coverage can be sporadic). There have been very few 
iEEG studies of social agent perception that have focused on stim- 
uli other than whole-faces. One of the few such reports found 
that images of hands evoked a category-selective event-related 
potential (ERP) from recording sites on the right VOTC and left 
LOTC cortices (McCarthy et al, 1999). At these locations there 
was no concomitant category-selective response to faces or face- 
parts (eyes, lips, and noses). Similarly, a more recent report found 
a single body-selective site on the right LOTC at which there was 
no appreciable response to faces (Pourtois et al, 2007). 

These findings provide limited support for the idea that face 
and non-face body parts are processed in distinct brain areas. 
However, given the extent of the activation overlap between faces 
and bodies observed in fMRI, a more systematic study is war- 
ranted, particularly since one of the two aforementioned studies 
used images of isolated hands rather than bodies as a stimulus 
(McCarthy et al., 1999). Subsequent neuroimaging has shown 
that hands and bodies evoke dissociable neural responses (Bracci 
et al., 2010). The second study reported results from a single elec- 
trode within a single patient. Small samples are common in iEEG 
as this method relies on the participation of individuals under- 
going invasive brain procedures, often for pharmacologically 
intractable epilepsy. Nonetheless, results from a single electrode 
raise concerns about the replicabUity and generalizabUity of the 
findings. 

Here we use iEEG to investigate the functional selectivity and 
spatial relationship of the response to three visual categories of 
social agents (whole faces, eyes in isolation, and headless-bodies). 
Both time-locked ERPs and event-related spectral perturbations 
(ERSPs) were investigated. We address the possible limitations 
of previous iEEG experiments by using images of whole bodies 
(without heads) rather than isolated body parts, and by using 
a large sample of 1536 electrode sites across twelve patients. In 
addition to evaluating the amplitude of the ERP at each subdural 
electrode to faces, bodies, and eyes, we also examined the spa- 
tial distribution of the ERPs evoked by each stimulus type across 
adjacent electrodes. The spatial configuration of current sinks and 
sources relative to the recording electrodes determines the spa- 
tial distribution of voltage over the cortex. If the same source 
configuration was responsible for the ERP evoked by each dif- 
ferent stimulus, then the spatial distribution would be the same. 
However, if the spatial distribution of voltage evoked by faces, 
bodies, and eyes differed across closely adjacent sites, this would 
be strong evidence that a different pattern of neural activity, 
and perhaps a different subset of neurons, was activated by the 
different stimulus categories. 

MATERIALS AND METHODS 
PROCEDURE 

Stimulus presentation was computer controlled and displayed on 
a 17" LCD monitor (800 x 600 pixels) positioned on a table over 
the patient's bed. The viewing distance was adjusted for patient 
comfort. Patients were asked to view sequentially presented stim- 
uli that were randomly selected from four categories: novel faces, 
eyes in isolation, headless bodies, and flowers (Figures 1A,B). In 



total, patients viewed 40 unique exemplars from each stimulus 
category. Each image was displayed for 750 ms with a jittered 
stimulus onset asynchrony that varied randomly between 1800 
and 2200 ms (Figure IC). In the first version of the experiment 
(see below) images from the face, eye, body, and flower categories 
were presented a roughly equal number of times (77-83 trials 
of each for patient 1, and 174-188 trials of each for patient 2). 
In the second version, 40 trials were presented from each of 
these categories. Two patients experienced a longer version in 
which 80 trials were presented from each category. To ensure the 
patient's engagement with the task, a target circle was presented 
on ~ 1 1 . 1 % of trials to which a speeded button press response was 
required. Presentation of the stimuli was intermittently paused to 
give the patients a rest period. 

STIMULI 

The first two of our twelve participants saw grayscale images 
(Figure lA). Face stimuli were created from photographs taken 
from various sources (see Allison et al., 1999 for details). Eye 
stimuli were the same pictures used for faces, but cropped so 
that only the eye-region remained visible. Body stimuli were pho- 
tographs of males and females, digitally cropped so that the head 
was removed. Flower stimuli were color photographs converted 
to grayscale images. Prior studies from our laboratory have shown 
that face-selective ERPs evoked at subdural VOTC electrodes are 
readily dissociable from many different non-corporeal object cat- 
egories, including letter strings, patterns, and flowers (cf Allison 
et al, 1994a, 1999; McCarthy et al, 1999; Engell and McCarthy, 
20 1 0, 20 11 ). We chose flowers as control stimuli because they are a 
category of living stimuli with visual symmetry and can be readily 
individualized. 

The remaining ten participants saw color stimuli (Figure IB). 
Face stimuli were realistic faces created using FaceGen (Singular 
Inversions, Toronto, Ontario, Canada). Eye stimuli were the same 
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images used for faces, but cropped so that only the eye-region 
remained visible. Body stimuli were created using Poser 6.0 
(Curious Labs Inc., Santa Cruz, California, USA). Flower stimuli 
were the same as those described above, but were not converted 
to grayscale. 

EEG ACQUISITION 

Recordings were obtained from 1536 electrodes implanted in 12 
patients (median age = 33 years, age range: 18-54 years, 8 female, 
4 male) with medically intractable epilepsy who were being eval- 
uated for possible surgery by the Yale Epilepsy Surgery Program 
(Spencer et al, 1982). In these patients, strips or grids of stainless 
steel electrodes (2.2 mm surface diameter) were placed subdurally 
on the cortical surface. The placement of the strips was deter- 
mined by the clinical needs of each patient, and thus electrode 
locations varied across individuals. The studies reported here 
were included among other sensory and cognitive experiments 
in which each subject participated, typically 4-8 days following 
implantation of electrodes. At the time of participation, medi- 
cation levels to control seizures and post-operative pain varied 
across patients. The EEG experiments were not conducted imme- 
diately before or after seizures nor were any of our sites of interest 
revealed to be in epileptogenic cortex. The EEG protocol was 
approved by the IRB of the Yale University School of Medicine. 
All participants provided informed consent. 

Local field potentials were recorded and amplified with a com- 
mon reference using an SA Instruments EEG amplifier system 
with a 0.1-100 Hz bandpass. The reference was a small post 
implanted in the outer table of the patient's skull. The location of 
this post varied across patients, but it was always in the skull adja- 
cent to superior frontal or parietal cortex. Most often, the post 
was implanted at the top of the skull in a region roughly adja- 
cent to electrodes C3 or C4 of the 10-20 EEG Electrode system. 
From each patient we simultaneously recorded from 128 elec- 
trodes with a concentration of sites on ventral occipitotemporal, 
lateral occipital, posterior lateral temporal, and parietal cortices. 
The EEG signal was continuously digitized with 14-bit resolution 
and a sampling rate of 500 Hz using a Microstar 4200 A/D data 
acquisition board. The digitized signal was written to disk using 
a custom PC-based acquisition system. A digital code unique to 
each experimental condition was recorded in a separate channel 
at the onset of each stimulus presentation. 

ELECTRODE LOCALIZATION 

A high-resolution anatomical scan (1 x Ix 1.5 mm) was acquired 
for each patient prior to implantation. Post-implant CT scans 
in which the electrodes were easily detected and localized 
in 3D were then co-registered to the anatomical MR data. 
Each patient's brain was transformed to MNI space using the 
Bioimage Suite software package (http://www.bioimagesuite.org) 
to facilitate visualization of recording sites of interest from all 
patients on a standard brain. In cases in which the inher- 
ent imprecision of spatial normalization resulted in an elec- 
trode appearing just off the brain, the electrode position was 
projected to the cortical surface. This approach allowed for a 
convenient graphical representation of the overall distribution 
of electrodes on the brain's surface (Figures 2A, 3). However, 



as the exact gyral and sulcal boundaries of the brain var- 
ied among our subjects, this summary view does not precisely 
reflect the location of any individual electrode with respect to 
anatomical landmarks of the subject's brain in which it was 
located. 

Instances of conditional voltage changes over space (see Rate 
of Voltage Changes Over Space) are also displayed on cortical 
surfaces. In an effort to preserve the relationship of electrode 
locations to sulcal and gyral boundaries, we projected these elec- 
trodes on to each individual's brain (Figure 4, PI, P2, P3, P4, 
& P7). However, for two of the participants the signal to noise 
was insufficient to achieve quality segmentation so the electrodes 
from these individuals are shown on a canonical brain surface 
(Figure 4, P5&P6). 

EVENT-RELATED POTENTIAL (ERP) ANALYSIS 

ERP analyses were performed using custom MATLAB (The 
Mathworks, Inc.) functions. Residual line noise (60 Hz) filtering 
was performed in Matlab using a 5th order Butterworth filter that 
was applied in a temporally symmetric manner to avoid intro- 
ducing phase shifts. Baseline adjusted ERPs were created by signal 
averaging the EEG across trials for each experimental condition 
and subtracting from each time-point the average of a 100 ms 
pre-stimulus epoch. Low-pass filtering was achieved with a tem- 
porally symmetric smoothing kernel with a total length of five 
time-points (from —2 to +2 time points) that was convolved 
with the average ERP waveforms prior to amplitude and latency 
measurements of the N200. 

A computer algorithm was used to identify electrodes that were 
"selective" for a particular category. Guided by previously pub- 
lished criteria (Allison et al., 1999), face-, eye-, and body-selective 
sites were defined as those with a peak negativity occurring 
between 160 and 240 ms post stimulus onset (N200) that was at 
least —50 (i,V in amplitude and at least twice as large for the cat- 
egory of interest than for the control condition (flowers). Similar 
selection criterion (i.e., a category response twice as large as for 
all other tested categories) has previously been used in both sin- 
gle cell (e.g., Perrett et al., 1982; Baylis et al, 1985; Leonard et al., 
1985) and human local field potential (LFP) (e.g.. Puce et al., 
1997; Allison et al., 1999; McCarthy et al, 1999; Puce et al, 
1999; Engell and McCarthy, 2010, 2011) investigations of face- 
selective responses. Consistent with previous human LFP studies, 
this was based on the qualitative comparison of the peak magni- 
tude of ERPs. Automated detection by the computer algorithm 
was followed by visual inspection by the authors to screen for 
artifacts. Nine of 41 face-selective electrodes, three of 54 eye- 
selective electrodes, and seven of 29 body-selective electrodes that 
were identified by the computer algorithm were excluded from 
analysis. 

For each set of category-selective electrodes, we created an 
average ERP from all electrodes contributed by a given patient. 
We then identified the peak amplitude of each category-evoked 
response from within our epoch of interest (160-240 ms) and 
the latency at which the peak occurred. Wilcoxon signed rank 
tests were then used for pairwise contrasts of the four conditions 
to test for differences in the peak amplitude and latency of the 
N200 response. For each group of category-selective electrodes. 
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FIGURE 2 I ERP and yERSP response at category-selective sites. 

(A) The locations of 69 category-selective electrodes displayed on a 
standard brain (left panel). Selectivity was defined by contrasting each 
of the conditions of interest (faces, eyes, bodies) to flowers. Therefore, 
a single electrode could be identified as "selective" for more than one 
condition. The color at each location indicates which category (or 
categories) met selectivity criteria (see Materials and Methods). For 
reference to standard imaging results, the ORANGE overlay indicates 
voxels at which there is a >33% probability of being face-selective in a 
face vs. scene fMRI experiment (Engell and McCarthy, 2013). (B) The 
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grand-average ERPs for each condition were calculated at all electrodes 
that were category-selective for one or more conditions. The 
grand-averages can therefore include sites that were selective for 
multiple conditions. For instance, the body-selective ERP (bottom row) 
includes the response recorded from the "Body," "Face & Body," and 
"Face & Eye & Body" locations. The grand average ERP was created 
by averaging patient ERPs, which could each include one or more 
electrodes. We report both the patient sample size (W) and the total 
number of electrodes. (C) The relative increase in event-related gamma 
power at the same category-selective sites. 




• Face • Body • Eye 



FIGURE 3 I Category-specific sites. The locations of category-specific 
electrodes overlaid on a standard brain. At these sites, the 
category-selectivity was determined by contrasting the condition of interest 
to all other conditions, not only flowers. Using this more conservative 
criterion we found three face-selective, thirteen eye-selective, and one 
body-selective site. A color border indicates electrodes that were 
contributed by the same patient. For instance, the orange border around 
the eye selective sites on the left and the right occipitotemporal cortex 
indicates that the same patient contributed these two electrodes. 



we performed five pairwise tests, which included all possible pair- 
ings except for the category-selective condition vs. flowers. The 
latter test was not performed because category vs. flower was 
our selection criteria. We used a Bonferroni correction to adjust 
the significance threshold for our five contrasts from p < 0.05 to 
p < 0.01. 



The normalized locations (MNI) of the category-selective 
electrodes were plotted onto a standard brain (Figure 2A). 
K-means clustering, as implemented with the "kmeans" function 
in MATLAB's (The Mathworks, Inc.) Statistics Toolbox, was used 
to further summarize the electrode locations by segmenting them 
into four clusters and identifying the locations of the cluster cen- 
troids. We chose fc = 4 because visual inspection of the electrode 
locations suggested a cluster on the ventral temporal surface, and 
another on the occipitotemporal surface of each hemisphere. The 
selection of four clusters was supported by the quantitative obser- 
vation that four clusters explained 89, 85, and 87% of the total 
spatial variance for faces, eyes, and bodies, respectively. 

To test for latency differences we identified the peak of the 
N200 (minimum amplitude) within our critical time window 
(160-240 ms) for each electrode. The latencies of these peaks for 
each condition were then contrasted using Wilcoxon signed rank 
tests. 

Finally, we identified category-speayic electrodes. At these sites 
the response to a given category (faces, eyes, or bodies) met 
the criteria for selectivity as compared to all other corporeal 
categories and flowers. 

RATE OF VOLTAGE CHANGES OVER SPACE 

The changes in voltage created by the current sinks and sources 
of active neurons can be recorded throughout the volume con- 
ductor of the brain, but the strength of the voltage diminishes 
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FIGURE 4 I Peak-voltage changes over space. We visually identified 12 
locations (seven patients) at which adjacent electrodes showed an N200 to 
at least two of our conditions of interest (faces, eyes, bodies), and at 
which the peak-voltage to these conditions changed at different rates over 
space. For patient IE (top row, left column) we display the waveform from 
two adjacent electrodes on the right ventral temporal surface. Inspection 
of these waveforms shows that at electrode El there is a prominent N200 
to both faces and eyes, but not bodies. At the adjacent electrode, E2, 



bodies evoke an N200 that is qualitatively larger than faces and eyes. 
Moreover, compared to the response at El the eye-N200 has diminished 
more sharply than the face-N200. The log of the peak difference is 
displayed in the bar graph. For all other patients we display only these bar 
graphs to represent the rate of change for each of the three conditions. At 
each location (i.e., each collection of adjacent sites) two or more of the 
conditions experience a different rate of change over space, indicating 
differing patterns of current sinks and sources. 



with distance from the source, resuhing in a weaker signal at 
more distal recording sites. The rate at which this signal decays 
(as a percentage of the peak amplitude) should be the same for 
ERPs generated by the same configuration of current sinks and 
sources; this is true regardless of the initial strength of the sig- 
nal. If ERPs evoked by two different stimulus categories fall off 
at different rates across adjacent electrodes it indicates a different 
configuration of sinks and sources, and thus a different pattern 
of neural activity. We looked for all instances of differential volt- 
age changes over space in the peak ERP response to faces, eyes. 



and bodies by visually inspecting all ERPs from the 12 patients. 
At these locations, we quantified the change for each condition 
by calculating the log of the peak voltage difference between the 
adjacent electrodes. This returned a complex number for nega- 
tive peak differences. For these values we report the negative of 
the real part of the complex number. 

EVENT-RELATED SPECTRAL PERTURBATION (ERSP) ANALYSIS 

In addition to the ERP analysis, we also analyzed the EEG using 
a time-frequency approach that evaluated event-related changes 
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in gamma power (gamma event-related spectral perturbations; 
yERSP) at each of the category-selective sites. Following our prior 
reports (Engell and McCarthy, 2010, 2011, 2014) we removed 
the mean signal-averaged ERP from the raw EEG signal for each 
trial prior to ERSP analysis. This ensured that any significant 
spectral differences between categories did not merely reflect the 
frequency composition of the phase-locked ERP. As a result of 
this approach, the frequency-domain analysis reported here is 
insensitive to spectral changes that undergo phase resetting (i.e., 
phase-locked "evoked" EEG responses). However, these signal 
components are well captured in the time-domain analysis (i.e., 
ERP), resulting in a full characterization of the data. 

Event-related spectral perturbations were computed using 
EEGLAB v7.1 (Delorme and Makeig, 2004) and MATLAB v7.9 
(The Mathworks, Inc.). Time-frequency power spectra were esti- 
mated using Morlet wavelet analysis based on 3 cycles at the 
lowest frequency (11.6 Hz) increasing to 16 cycles at the highest 
frequency (125 Hz). Change in power induced by each category 
(i.e., ERSP) was estimated by calculating the ratio of log power 
(dB) between the post-stimulus and pre-stimulus epochs. ERSPs 
within the gamma band (30-100 Hz) were averaged at each time- 
point to create a "gamma power-wave" over time. This frequency 
range for gamma was selected on the basis of the prior literature. 
Reports in the animal (Singer and Gray, 1995; Tallon-Baudry and 
Bertrand, 1999) and human (e.g., Lachaux et al., 2005; Tsuchiya 
et al., 2008; Fisch et al, 2009; Engell and McCarthy, 2010, 2011, 
2014; Engell et al., 2012) literatures have defined 30 Hz as the 
lower bound of the gamma band. These same human intracra- 
nial studies have reported an upper bound for gamma between 70 
and 200 Hz. The amplifiers used in our studies imposed a 100 Hz 



(— 3db) upper limit on the iEEG signal, so we restricted the upper 
range of the gamma band to 100 Hz. For each condition and each 
site with a category-selective N200 we estimated the area under 
curve (AUC) within an epoch that appeared to be most sensi- 
tive to the task (Engell and McCarthy, 2011, 2014; Engell et al, 
2012). Across conditions, 150-600 ms showed the largest changes 
in gamma power for all conditions and we therefore focused our 
analysis on this window. Where appropriate these AUC estimates 
were contrasted with paired-sample f-tests. 

RESULTS 

EVENT-RELATED POTENTIALS 
Face-selective electrodes 

We identified 32 face-selective electrodes (20 RH, 12 LH) across 
1 1 patients (Table 1, Figure 2). At these locations, the peak ampli- 
tude medians of faces, eyes, bodies, and flowers were —106.66, 
—94.32, —50.54, and —19.40, respectively. The Wilcoxon signed 
rank test showed that the face response was larger (i.e., more neg- 
ative) than the body response, Z = 2.76, p = 0.006, but not the 
eye response, Z = 1.07, p = 0.286. Note that selection of these 
sites was solely based on the faces > control contrast, so the selec- 
tion process did not necessitate that faces would be larger than 
bodies or eyes. The peak response to eyes was larger than bodies, 
Z = 2.93, p = 0.003, and flowers, Z = 2.93, p = 0.003. The peak 
response to bodies was larger than flowers, Z = 2.85, p = 0.004. 

The latency medians of faces, eyes, bodies, and flowers were 
162, 178, 186, and 192 ms, respectively. The Wilcoxon signed rank 
test showed that the face response was marginally earlier than 
the eye response, Z = 2.54, p = 0.011, and significantly earlier 
than the body response, Z = 2.67, p = 0.008. The latency of the 



Table 1 | Electrode locations of face-selective sites within each spatial cluster. 
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The MNI coordinates from each of the 32 face-selective electrodes are grouped according to which cluster they were assigned to by the k-means clustering analysis. 
The MNI coordinates in the first row are the centroid locations within each cluster Coordinates in bold typeface indicate electrodes that were face-specific as well 
as face-selective (see Matehals and Methods). 
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peak to eyes did not differ from the latency of the peak to bod- 
ies, Z = 1.11, p = 0.266, but was marginally earlier than flowers, 
Z = 2.40, p = 0.016. Bodies and flowers did not differ, Z = 0.71, 
p = 0.476. 

The cluster detection algorithm (see Materials and Methods) 
identified two spatial clusters of electrodes within each hemi- 
sphere for face-selective responses. The cluster centroids in the 
right hemisphere were located at 33, —55, 17 and 27, —80, —8. 
The cluster centroids in the left hemisphere were located at 
-46, -59, -20 and -38, -89, 1 (Figures). Despite the 
sparse sampling inherent in iEEG, these centroids roughly cor- 
responded to face-selectivity peaks as identified by the Atlas 
of Social Agent Perception (Engell and McCarthy, 2013). The 
small sample sizes within each cluster precluded statistical anal- 
ysis of the ERPs. We describe the relevant qualitative results 
from within these clusters in the context of our discussion 
section. 

In a second analysis, we identified iace-specific, rather than 
face-selective (see Materials and Methods), electrodes. We found 
three face-specific sites (2 RH, 1 LH) contributed by three patients 
(bolded coordinates in Table 1). 

Eye-selective electrodes 

We identified 51 eye-selective electrodes (30 RH, 21LH) 
across 12 patients (Table 2, Figure 2). At these locations, the 



peak amplitude medians of faces, eyes, bodies, and flowers 
were -51.66, -97.79, -27.40, and -15.16 |xV, respectively. 
The Wilcoxon signed rank test showed that the eye response 
was larger than the response to faces, Z = 2.90, p = 0.004, and 
bodies, Z = 3.06, p = 0.002. The average peak response to faces 
was significantly larger than to bodies, Z = 2.75, p = 0.006, and 
flowers, Z = 3.06, p = 0.002. The body response was marginally 
larger than the flower response, Z = 2.20, p = 0.028. 

The latency medians of faces, eyes, bodies, and flowers were 
168, 179, 187, and 182 ms, respectively. The Wilcoxon signed rank 
test showed that the eye response was significantly later than the 
face response, Z = 2.71, p = 0.007, but did not differ from the 
body response, Z = 0.67, p = 0.505. The latency of the peak to 
faces was marginally earlier than bodies, Z = 1.94, p = 0.052, 
and significantly earlier than flowers, Z = 2.59, p = 0.010. Bodies 
and flowers did not differ, Z = 1 .57, p = 0. 1 16. 

The cluster detection algorithm identified two spatial clusters 
of electrodes within each hemisphere for the eye-selective ERPs. 
The cluster centroids in the right hemisphere were located at 
33, -55, 18 and 38, -85, -2. The cluster centroids in the left 
hemisphere were located at —40, —68, —12 and —31, —92, 1 
(Figure 5). The small sample sizes within each cluster precluded 
statistical analysis of the ERPs. We describe the relevant qualitative 
results from within these clusters in the context of our discussion 
section. 
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FIGURE 5 1 Results of spatial-clustering. (A) The locations of the 
centroids from the k-nneans cluster analysis as seen on the right 
ventral tremporal (Right VT; 1st row), right occipitotemporal (Right OT; 
2nd row), left ventral temporal (Left VT; 3rd row), and left 
occipitotemporal (Left OT; 4th row) surfaces. Centroids are displayed 
for faces (red), eyes (green), and bodies (blue). (B) Grand-average 
ERPs were calculated from the electrodes within each spatial cluster. 
The "I" bar in each plot represents 50 (iV along the y-axis and is 



located along the x-axis at the time of stimulus onset. We report 
both the patient sample size (N) and the total number of electrodes 
included in each ERR Bar graphs show the relative increase in 
event-related gamma power (AUC of log power change from baseline) 
at these same electrodes. Bar height indicates AUC between 0 and 
100 db^. Note, only increases in gamma power are shown. At the 
body-selective sites in the left ventral and occipitotemporal regions 
there was desynchronization to flowers and to eyes, respectively. 
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Table 2 | Electrode locations of eye-selective sites within each spatial cluster. 



MNI Coordinates of Eye-Selective Electrode Locations [N = 51) 




Right ventral temporal 


Right occipitotemporal 


Left ventral temporal 






Left occipitotemporal 


X 


Y 


Z 


X 


Y 


Z 


X 


Y 




X 


Y 


Z 


33 


-55 


-18 


38 


-85 


-2 


-40 


-68 


-^2 


-31 


-92 


1 


45 


-41 


-28 


54 


-72 


3 


-8 


-64 


-9 


-9 


-98 


-1 


45 


-49 


-26 


53 


-78 


3 


-30 


-73 


-11 


-15 


- 98 


4 


45 


-56 


-22 


51 


-77 


-5 


-34 


-61 


-23 


-18 


-98 


-9 


40 


-50 


-16 


44 


-85 


-4 


-39 


-68 


-12 


-25 


-96 


8 


40 


-58 


-21 


43 


- 86 


-4 


-42 


-42 


-26 


-29 


-91 


-11 


40 


-67 


-25 


37 


-97 


-9 


-45 


-82 


-14 


-29 


-99 


5 


40 


-67 


-25 


36 


-81 


36 


-52 


-74 


-14 


-36 


-88 


-13 


37 


-58 


-20 


35 


-91 


-7 


-53 


-71 


-3 


-37 


-93 


7 


35 


-57 


-19 


32 


-91 


-12 


-55 


-75 


1 


-41 


-85 


2 


34 


-32 


-27 


22 


-94 


-9 








-41 


-89 


-4 


33 


-63 


-17 


12 


-82 


-14 








-43 


-85 


11 


29 


-52 


-13 














-45 


-84 


9 



29 -63 -18 

27 -53 -14 

27 -56 -15 

26 -46 -17 

24 -70 -14 

20 -56 -6 

18 -51 -8 



The MNI coordinates from each of the 51 eye-selective electrodes are grouped according to which cluster they were assigned to by the k-means clustehng analysis. 
The MNI coordinates in the first row are the centroid locations within each cluster Coordinates in bold typeface indicate electrodes that were eye-specific as well 
as eye-selective (see Materials and Methods). 



In a second analysis, we identified eye-specific, rather than 
eye-selective (see Materials and Methods), electrodes. We found 
13 eye-specific sites (4RH, 9LH) contributed by eight patients 
(bolded coordinates in Table 2). Within patients fi-om whom 
several eye-specific sites were identified, there was only one 
instance in which the electrodes were closely adjacent. In all other 
cases the electrodes were located in different within-hemisphere 
locations (e.g., lateral temporal and ventral temporal cortices) or 
in different hemispheres. 

Body-selective electrodes 

We identified 21 body-selective electrodes (15 RH, 6LH) 
across ten patients (Table 3, Figure 2). At these locations, the 
peak amplitude medians of faces, eyes, bodies, and flowers 
were -83.63, -69.88, -75.45, and -21.30 jtV, respectively The 
Wilcoxon signed rank test showed that the body response was 
not larger than faces, Z = 0.56, p = 0.575, or eyes, Z = 0.66, p = 
0.508. The average peak response to faces was significantly larger 
than to flowers, Z = 2.60, p = 0.009, but not to eyes, Z = 0.05, 
p = 0.959. The eye response was marginally larger than the flower 
response, Z = 2.50, p = 0.013. 

The latency medians of faces, eyes, bodies, and flowers were 
181, 195, 182, and 197 ms, respectively. The Wilcoxon signed rank 
test showed that the body response did not differ from the latency 
of the response to faces, Z = 1.40, p = 0.161, or eyes, Z = 0.83, 
p = 0.406. The latency of the peak to faces was marginally earlier 



than eyes, Z = 2.45, p = 0.014, but did not differ from flowers, 
Z = 1.74, p = 0.083. Eyes and flowers did not differ, Z = 0.12, 
p = 0.906. 

The cluster detection algorithm identified two spatial clus- 
ters of electrodes within each hemisphere for eye-selective ERPs. 
The cluster centroids in the right hemisphere were located at 
36, —55, 19 and 45, —83, —2. The cluster centroids in the left 
hemisphere were located at —34, —48, —22 and —20, —96, 5 
(Figure 5). The small sample sizes within each cluster precluded 
statistical analysis of the ERPs. We describe the relevant qualitative 
results from within these clusters in the context of our Discussion 
Section. 

In a second analysis, we identified hody-specific, rather than 
hody-selective (see Materials and Methods), electrodes. We iden- 
tified only one body-specific site, which was located in the left 
hemisphere (bolded coordinates in Table 3). 

VOLTAGE CHANGES OVER SPACE 

We visually identified 10 occurrences from seven patients in 
which the peak of the ERP to all, or some, of the categories of 
interest changed at different rates across neighboring electrodes 
(Figure 4). Of these 10, seven were located on the ventral surface 
(6 right hemisphere) and three on the lateral occipitotemporal 
surface (1 right hemisphere). At many of these locations the most 
notable difference was between bodies and the other conditions. 
However, the peak rate of change between faces and eyes also 
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Table 3 | Electrode locations of body-selective sites within each spatial cluster. 



MNI Coordinates of Body-Selective Electrode Locations (/V = 21) 



Right ventral temporal Right occipitotemporal Left ventral temporal Left occipitotemporal 



X 


/ 


Z 


X 


Y 


Z 


X 


Y Z 


X 


Y 


Z 


36 


-55 


- 19 


45 


-83 


2 


-34 


-48 -22 


-20 


-96 


5 


50 


-61 


-26 


53 


-72 


-6 


-34 


-48 -22 


-6 


-95 


11 


45 


-56 


-22 


53 


-78 


3 






-6 


-96 


6 


40 


-50 


-16 


47 


-79 


-9 






-23 


-102 


2 


40 


-58 


-21 


47 


-85 


-2 






-25 


-96 


8 


36 


-31 


-29 


39 


-88 


12 






-41 


-89 


-4 


33 


-63 


-17 


29 


-93 


14 












29 


-52 


-13 


















27 


-53 


-14 


















24 


-70 


-14 



















The MNI coordinates from each of the 2 1 body-selective electrodes are grouped according to which cluster they were assigned to by the k-means clustering analysis. 
The MNI coordinates in the first row are the centroid locations within each cluster Coordinates in bold typeface indicate an electrode that was body-specific as well 
as body-selective (see Materials and Methods). 



differed, though this difference was often more subtle than that 
of bodies. 

EVENT-RELATED SPECTRAL PERTURBATIONS 

Across the electrodes that were selective for faces {N = 32), eyes 
(N = 51), and bodies (N = 21), we observed substantial change 
in gamma power as an effect of stimulus presentation. However, 
there were few differences between categories. At the face-selective 
ERP locations the face-yERSP was larger than the eye-yERSP, 
t(jQ) = 3.69, p = 0.004, and marginally larger than the body- 
yERSP, f(io) = 2.46, p = 0.03. There were no other pairwise dif- 
ferences, ps > 0.01. At the eye-selective ERP locations eye-yERSP 
was smaller than the face-yERSP, f(ii) = 3.12, p = 0.010. This 
same relationship was seen even when only including face-specific 
sites in the eye-yERSP average. At these sites the face-yERSP was 
also marginally larger than the body yERSP, f(ii) = 2.67, p = 
0.022. There were no other pairwise differences, ps >0.01. At the 
body-selective ERP locations there were no pairwise differences 
between conditions, /is >0.01. 

We also investigated the category-selective yERSPs within each 
of the four spatial clusters identified by the cluster detection algo- 
rithm. As with the ERPs, the small samples within each cluster 
precluded statistical analyses. We describe the relevant qualitative 
results from within these clusters in the context of our discussion 
section. 

DISCUSSION 

In this paper we report several findings regarding the selectiv- 
ity and organization of cortical areas engaged in the percep- 
tion of faces, eyes, and bodies. Overall, we found substantial 
overlap in the activation by the three corporeal stimuli. The 
majority of electrodes selective for one of the three corporeal 
categories were selective for one or both of the other categories. 
However, we did identify several electrode sites that were specific 
for only a single category — particularly for eyes. Furthermore, 
we report evidence for different spatial distribution of voltage 



evoked by the three corporeal stimuli at closely adjacent elec- 
trodes. This indicates that the ERPs evoked by these stimuli 
are being generated by different configurations of current sinks 
and sources despite their substantial spatial overlap. In the fol- 
lowing section we will discuss the evidence for this as well as 
general observations regarding the response properties and loca- 
tions of face, eye, and body selective sites. We conclude by 
discussing these findings in the context of the perception of 
social agents. 

NEURAL SELECTIVITY OF RESPONSES 

Locations showing selectivity for at least one of the categories 
of interest were found widely distributed across bilateral VOTC. 
No category-selective locations were found in the frontal or pari- 
etal lobes. The wide spatial distribution observed in VOTC is 
consistent with prior iEEG reports from our laboratory (e.g., 
Alhson et al, 1994a, 1999; Engell and McCarthy, 2010, 2011), 
but inconsistent with fMRI studies that often report highly local- 
ized selective regions (e.g., Sergent et al., 1992; Haxby et al., 1994; 
Puce et al, 1995; Kanwisher et al, 1997; Gauthier et al, 2000; but 
see Pinsk et al., 2009; Weiner and Grill-Spector, 2013). We used a 
cluster detection algorithm to assign each category-selective elec- 
trode to one of four spatial clusters, and then identified the cen- 
troids of those clusters. For each of the social agent conditions, the 
centroids (Figure 5) were well aligned to face- and body-selective 
areas identified in the fMRI literature. Face-selective electrodes 
clustered around the FFA (ventral temporal cortex) and OFA 
(posterior and lateral occipitotemporal cortex) in each hemi- 
sphere, as did eye- and body-selective electrodes. These findings 
suggest that group analysis of fMRI data has emphasized regions 
of maximal overlap at the expense of detecting spatial variability 
across, and perhaps within, individuals. Weiner and Grill-Spector 
(2013) have recently reported that high-resolution fMRI of indi- 
vidual participants shows that face- and body-selective regions 
repeat throughout the occipitotemporal cortex. If so, our findings 
might reflect a coarse sampling of this repeating pattern. 
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Face-selectivity 

Category-selective face-N200s were identified at 32 locations 
across 11 patients. Consistent with a prior report (McCarthy 
et al., 1999), the peak of the face-N200 at these sites was qual- 
itatively larger and earlier than the peak of the eye-N200. The 
face-N200 was also larger than the body-N200. Despite being 
selected for their face-selectivity, the body-N200 and eye-N200 
at these face-selective sites was greater than the ERP evoked by 
flowers. Therefore, the underlying cortex is sensitive to non- 
face images of social agents, despite being optimally activated by 
faces. Notably though, the locations of the face-selective sites were 
widely distributed across bilateral VOTC and thus might span 
functionally heterogeneous regions that include some areas, such 
as the FFA located in right ventral temporal cortex (rVT), that are 
more face-selective than others. 

Of the 32 face-selective electrodes, 14 were located within the 
rVT region, suggesting that there might indeed be greater face- 
selectivity within this region. However, the responses at these sites 
did not appreciably differ from those in our other three regions of 
interest. Perhaps more surprising was that none of the 14 face- 
selective sites within the rVT met the criteria to be faiCe-specific. In 
other words, no electrodes on or around the FFA, a region often 
considered to be a functional module for face perception, were 
category-selective for faces as compared to eyes and/or bodies. 

Eye-selectivity 

Eyes are a critical feature of faces and attract the most attention 
during natural looking (Janik et al., 1978). In a previous iEEG 
study, McCarthy et al. (1999) found right VOTC and left LOTC 
sites at which face-parts (eyes, lips, noses) evoked a larger and 
later N200 than did whole faces. In that study, the authors aver- 
aged over the potentials independently evoked by eyes, lips, and 
noses. This approach creates the possibility that averaging in the 
potentially weaker responses of lips and noses wiU obscure eye- 
selective electrodes. Similarly, they averaged hands and flowers 
to create their control condition, and thus did not directly con- 
trast face-parts with non-face body parts. In the current study, 
we focused on eyes and identified 51 eye-selective sites across 
twelve patients. The grand-averaged response to faces, eyes, and 
bodies across these sites was very similar to the response from 
face-selective sites, with the exception that the eye response was 
qualitatively larger and later than the face response. As with 
the face-selective sites, the body response at these eye-selective 
sites was larger (though not significantly so) than the flower 
response. 

Unlike the face-selective sites, the eye-selective sites were more 
likely to also be category-specific. That is, 27 of the 51 sites were 
not identified as being selective for faces or bodies. Moreover, 
13 of those 27 sites were eye-specific, all but two of which were 
located in bilateral occipital and lateral occipitotemporal cortex. 

Body-selectivity 

Category-selective body-N200s were identified at 21 electrodes 
across ten patients. As with the face-selective sites discussed 
above, the body-selective sites were also sensitive to the other 
social agent categories. All three categories were larger than flow- 
ers at these sites, and all were highly similar to one another. 



There was only a single electrode site in a single subject at 
which the body-N200 was category-specific. In other words, we 
found no evidence of regions that preferred bodies to faces or 
eyes. Particularly striking was the response of the subgroup of 
electrodes from within the right ventral temporal cortex, which 
includes the so-called fusiform body area (Schwarzlose et al, 
2005). Here, the peak ERP response to bodies was qualitatively 
smaller than to faces or eyes (see Figure 5). The body-yERSP was 
also smaller than the face-yERSP. This contrasts to sites within 
the right occipitotemporal region (near the so-called extrastriate 
body area) where bodies elicited a larger N200 and yERSP than 
faces or eyes. 

INDEPENDENT OR SHARED NEURAL SUBSTRATE 

As discussed above, neuroimaging studies report substantial over- 
lap in VOTC brain regions activated by faces and bodies. The 
striking overlap of these networks is highlighted in a large- 
sample fMRI study (Engell and McCarthy, 2013). That study used 
dynamic "point light" displays (i.e., biological motion) rather 
than static body images, but the location and magnitude of acti- 
vation evoked by bodies and point-light displays are strongly 
correlated (Peelen et al, 2006). 

Our current ERP results offer some insight into the nature of 
this extensive overlap observed in fMRI. Consistent with fMRI 
studies, we found that electrodes sensitive to one visual cate- 
gory of animate agent (faces, eyes, or bodies) were frequently 
sensitive to one or both of the other categories. However, we 
found ten instances in which the amplitude of the peak ERP 
response changed at different rates across electrodes for two 
or more of the categories at closely adjacent electrodes. For 
instance, we observed a large difference in the rate of change for 
faces and for bodies (and to a lesser extent, eyes) across adja- 
cent electrodes located on the right fusiform gyrus of Patient 
IE (see Figure 4). Indeed, in this particular case the amplitude 
of the peak response increases for one condition while decreas- 
ing for the other. This differential rate of change in voltage 
across adjacent electrodes cannot be accounted for by a consis- 
tent configuration of current sources and sinks that is activated 
at different strengths. Rather it indicates that these ERP distri- 
butions are caused by a different pattern of input and/or the 
participation of at least some different neural elements for faces, 
bodies, and eyes. 

It is important to note that sites at which no evidence was 
found for the different spatial rates of change for faces, bodies, 
and eyes outnumbered sites at which we found such evidence. 
However, a favorable spatial relationship between electrode loca- 
tions and sink/source configurations is necessary to record 
category-selective N200s at neighboring electrodes. Therefore, an 
inability to find appropriate electrodes can be due simply to the 
unsystematic spatial sampling typical of subdural recordings. The 
presence of functionally heterogeneous, but spatially regular and 
interdigitated neurons at a scale much smaller than our inter- 
electrode distance could also result in indistinguishable voltage 
distributions with our methods. In contrast, we cannot think 
of alternative explanations that would account for differential 
rate change, thus making the ten instances across seven patients 
reported here compelling. 
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FACES: PART AND WHOLE 

An influential model of face processing posits that detection and 
representation of face-parts occurs in the "occipital face area" 
of the posterior occipitotemporal cortex (Haxby et al, 2001). 
Consistent with this model, we found the majority of eye-specific 
sites in bilateral posterior occipitotemporal cortex. In addition, 
there were few face-selective sites in this region. However, our data 
is inconsistent with another key feature of this model; namely, 
that the fusiform face area is primarily involved in holistic pro- 
cessing of the whole face. Eye-selective sites in this region slightly 
outnumbered face-selective sites. Moreover, we found no elec- 
trodes in this region that were face-specific when compared to 
isolated eyes and bodies. 

We have previously shown that the face-N200 is functionally 
distinct from the face-yERSP (Engell and McCarthy, 2010, 
2011) and have proposed that the former is involved in early 
detection, whereas the latter is involved in elaborative processing. 
It is notable then, that the face-yERSP was larger than the 
eye-yERSP at eye-selective ERP sites. The qualitative nature 
of these results demand caution, but we speculate that the 
elaborative processing of a whole face follows the initial evoked 
response to eyes. This would reconcile the current results with 
the neuroimaging literature because changes in gamma power, 
and not evoked-potentials, are most closely related to changes in 
the hemodynamic response (Mukamel et al, 2005; Niessing et al., 
2005; Lachaux et al, 2007; Koch et al, 2009; Ojemann et al., 
2010; Scheeringa et al, 2011; Hermes et al, 2012). However, 
we observed that the face-yERSP is larger than the eye-yERSP 
at eye-selective sites within the OFA region as well, which is 
inconsistent with fMRI reports of a greater OFA response to 
face-parts(Liu et al., 2010). 

CONCLUSIONS 

Direct electrical recordings from the surface of the fusiform gyrus 
and adjacent VOTC and LOTC show a complex pattern of activa- 
tion for the perception of faces, bodies, and eyes. Most electrodes 
selective for one category of corporeal stimuli (relative to the con- 
trol category of flowers) showed selectivity for the other corporeal 
categories as well. This was particularly true for body stimuli — 
only one electrode site of 1536 total sites examined, and of 69 sites 
showing a response selective for at least one category of corpo- 
real stimuli, was specific for bodies. Perhaps most surprisingly, no 
electrode site in the vicinity of the fusiform face and body areas (as 
defined by fMRI studies) showed face or body specificity. These 
data do not, then, provide evidence for highly discrete processing 
regions for these different stimulus types. However, we did find 
a differential spatial distribution over closely adjacent electrodes 
for the maximum ERP response to bodies (and to a lesser extent 
for eyes) relative to faces. This suggests that within a given region, 
the different stimulus types engaged different configurations of 
current sinks and sources. Taken together, these results suggest a 
lumpy or patchy spatial representation for these different types 
of corporeal stimuli rather than segregation into highly discrete 
regions. 
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